TOP Metrics Library

AI

▼

Actualization Frequency

How often data, embeddings, or model snapshots are refreshed, measuring update cadence before age...

Actualization Lag

Time from source data changing to agent reflecting the change, measuring update speed before agen...

Agent Boundary Compliance

How consistently humans respect the defined use cases and avoid scope creep, unauthorized request...

Track the frequency and rate of AI agent failures, including task completion failures, errors, an...

Agent Throughput Gain

The increase in outputs per human after agents are added to a workflow, measuring whether agents ...

AI Literacy Density

How many people in the workflow understand sources of error, chain of consequence, boundary cases...

Autonomy Liability Ratio

The cost of autonomy (risk, oversight, legal load) relative to the benefit it produces, measuring...

Bottleneck Avoidance Score

Impact of agents on reducing wait states, approvals, dependencies, and queue times, measuring age...

Change Amplification Factor

Degree to which the agent amplifies or dampens organizational change. High CAF (positive) = accel...

Cognitive Offloading Efficiency

Does the agent meaningfully reduce mental load, or does it increase complexity? Measures whether ...

Compliance Overhead Factor

Total hours per month spent on AI compliance checks, policy audits, red-team tests, validation, a...

Consequence Awareness Index

How aware users are of second-order effects, risks, and downstream implications of using the agen...

Correction Recurrence Rate

How often the same type of mistake shows up again, measuring whether the agent system is learning...

Cost-Containment Efficiency

How effectively the agent decreases ongoing operational and labor costs over time, measuring cost...

Data Provenance Integrity

Can you trace where the data came from and whether it was allowed to be used? Measures data linea...

Decision Reversals

How often humans overturn an agent's action or recommendation, measuring agent decision quality a...

Drift Detection Time

Time until an organization notices that an agent is producing degraded results, measuring drift d...

Drift Sensitivity Forecast

How vulnerable the agent is to accuracy decline as time passes without updates, predicting when t...

Embedding Staleness Rate

Percentage of embeddings older than their update threshold, measuring embedding freshness for RAG...

Error Containment Efficiency

Percentage of agent errors caught before they escape into downstream processes, measuring error d...

Escalation Frequency

How often an agent asks a human for guidance, measuring agent autonomy and decision-making capabi...

Ethical Drift Potential

Likelihood that incremental changes in context or data result in behavior slipping outside accept...

Fail-Safe Coverage Index

Does the agent have fallback modes, safe defaults, policy-based shutdown, human takeover, and rol...

Governance Gravity

How much the agent 'pulls' compliance, security, or governance effort toward itself, measuring wh...

Guardrail Intervention Delay

Time from agent policy breach to automatic containment, measuring guardrail response speed and ef...

Hidden Single-Point Dependencies

Is the agent critically dependent on a dataset, index, or connector that only one person or one s...

Horizon Stability Rating

How stable the agent is over long time horizons (12+ months), considering evolving models, shifti...

Human Bottleneck Contribution

Percentage of agent delays caused by human behavior: slow approval, unclear instructions, inconsi...

Human Oversight Load

Hours humans spend reviewing, correcting, or authorizing agent actions, measuring the supervision...

Institutional Vulnerability Score

Risk that a failure of this agent results in significant institutional damage, including reputati...

Knowledge Dependency Ratio

How much the agent depends on external data sources that can break, lag, or conflict, measuring o...

Latency-to-Outcome

Time from agent receiving a trigger to delivering a verified result, measuring end-to-end decisio...

Latent Dead Data Ratio

How much of the underlying dataset is stale but still accessible to the agent, measuring hidden r...

Legal Exposure Velocity

Rate at which the agent accumulates legal/regulatory touchpoints, including regulated data use, p...

Meeting Displacement Rate

How many meetings were eliminated because agents handled the work upfront, measuring agentic AI's...

Misuse Frequency

How often users ask the agent the wrong thing, use it outside intended domain, bypass safety cons...

Model Update Toxicity

Risk that a model update causes unintended regressions or compliance failures, measuring update r...

Net Value Contribution

Does this agent produce enough net benefit to justify its existence? Includes throughput gain, re...

Operational Predictability Delta

Change in forecastability and outcome consistency after agents are added, measuring agentic AI's ...

Over-Reliance Incidents

Number of times users accepted agent output without verification in scenarios where verification ...

Overfit Risk Index

Likelihood that the agent will memorize patterns rather than generalize, measuring overfitting ri...

Oversight Decay Risk

Probability that oversight quality naturally drops over time because humans get comfortable, meas...

Policy-Conforming Action Ratio

Percentage of agent actions that stayed within allowed data, followed security policy, satisfied ...

Portfolio Fit Index

How much this agent overlaps with other agents or leaves gaps, measuring redundancy, cannibalizat...

Pre-Execution Compliance Score

Does the agent's data and training pipeline satisfy all compliance requirements before inference?...

RAG Conflict Potential

Probability that retrieved documents contradict fine-tuned or system prompts, measuring self-cont...

Regulatory Classification Error Rate

Percentage of tasks where an agent misclassified regulated vs non-regulated data, industry-specif...

Responsibility Attribution Clarity

Do people know who is responsible for bad outputs, who checks what, when to override, and who esc...

Retrieval Infrastructure Reliability

How often the retrieval pipeline (vector DB, indexer, connectors) fails or lags, measuring infras...

Retrieval Precision

Percentage of retrieved chunks that are actually relevant to the query, measuring retrieval quali...

Safe-Usage Competency Retention

How much of the training users retain after 30-90 days, measuring whether training leads to susta...

Scenario Vulnerability Spread

Range of reasonably foreseeable scenarios where the agent's behavior becomes unsafe, incorrect, o...

Second-Guess Frequency

How often users feel compelled to check the agent's work even when it's statistically unnecessary...

Semantic Consistency Index

How consistently concepts, fields, and entities are defined across datasets, measuring semantic a...

Sensitive Data Exposure Incidents

Number of times an agent handled data it shouldn't, forwarded sensitive content, injected PII int...

Single-Agent Dependency

How much the organization relies on one agent to keep a critical workflow alive, measuring operat...

Strategic Contribution Coherence

Does the agent move company-critical goals forward, or is it a novelty tool? Measures alignment b...

Task Autonomy Ratio

The percentage of tasks an agent completes end-to-end without human intervention, measuring true ...

Traceability Integrity Score

How reliably the organization can reconstruct what the agent did, why it did it, which data it sa...

Training Coverage Rate

Percentage of users who received the minimum required operational training for this agent, measur...

Training Data Entropy

Measures diversity vs. redundancy in the training data, assessing data distribution and represent...

Trust Calibration Score

Are users overtrusting the agent (dangerous), undertrusting the agent (wasteful), or calibrated (...

Unauthorized Action Prevention Rate

Percentage of blocked agent actions that would have violated permissions, data access, or policy,...

Under-Utilization Index

How often users revert to manual work despite the agent being capable, measuring resistance, fear...

Underlying Data Quality

How clean, correct, complete, non-duplicated, and up-to-date the agent's base data sources are, m...

User Operational Competence Score

How well users understand what the agent CAN and CANNOT do, where it breaks, how to verify output...

User-Led Risk Signals

How often users proactively flag drift, bias, weird behavior, or unexpected outputs, measuring or...

Workflow Friction Delta

Does human-agent interaction smooth the workflow or add steps? Measures whether agents reduce fri...

Individual

▼

Autonomous Work Ratio

Percentage of work an individual can complete without depending on the availability of others.

Build Failure Rate

Measures the percentage of a developer's builds that fail in the CI/CD Pipeline.

Cognitive Energy Metrics

Measures the number of simultaneous tasks an individual is managing at any given time, which impa...

Commit Frequency

Measures how often a developer commits code changes, reflecting their contribution to the codebase.

Context Switching Rate

Measures the number of times individuals are required to switch between tasks or meeting topics. ...

First Time Right Ratio

Measures the percentage of work an individual considers "Done" that did not return due to incompl...

Extent to which an individual engages in multitasking activities during work.

Non-value Added Time

Amount of time an individual spends on activities that do not contribute value (e.g. "overhead.")

Personal Meeting Overload

Measures the percentage of an individualâs available working hours consumed by meetings, hig...

Task Complexity Load Index

Measures the cognitive load imposed by the complexity of tasks, based on their dependencies, size...

Percentage of code an individual developer has covered with sufficient and useful tests. Identifi...

Time Spent Blocked

Amount of time an individual spends blocked from making progress due to external factors.

Team

▼

Administrative Overhead

Time spent on administrative tasks that do not directly contribute to value delivery.

API Contract Test Coverage

The percentage of API functionality covered by automated contract tests.

Automated Test Coverage

The percentage of code meaningfully covered with test automation.

Backlog Item Age

Measure of the time a backlog item remains in the backlog.

Measure of the percentage of backlog items completed.

Measure of the number of items in the team's backlog.

Measurement of how many degrees of separation exist between developers and end-users, indicating ...

Average age of active branches in the version control system.

Number of active branches in the version control system.

Average size of active branches in terms of code changes.

Total number of critical employees whose absence could significantly impact product development.

Change Failure Rate

Percentage of code changes that result in a red pipeline or at least one incident and/or defect.

Change Frequency

Number of code changes deployed to production per unit of time (e.g., week).

Change Lead Time

Time taken for a developed code change to produce a finalized build in a releasable condition.

Code Complexity

The average code complexity of the team's software components.

Code Quality Index

The overall code quality of the team's software components.

Code Review Rejection Rate

Percentage of code reviews that are rejected and require rework.

Code Review Time

Average time taken for code reviews from submission to approval.

Amount of code in the team's codebase that is inaccessible, part of unused features or otherwise ...

Average time taken to resolve defects.

Number of currently known defects.

Measures the number of defects per unit of code, providing insight into the quality of deliverables.

Defect Frequency

The rate at which new defects discovered in the product.

Average time demand items spend in the work-in-progress (WIP) state.

Demand WIP Count

Count of demand items in progress at a given time.

Deployment Frequency

Number of deployments made by the team within a specific time period.

Escalation Count

Number of issues escalated to management that require decisions or actions beyond the team's auto...

Escalation Resolution Age (ERA)

Captures the duration between the team flagging a topic for escalation and its resolution.

Extraordinary Meetings

Number of unscheduled meetings called to address urgent issues.

Measures the frequency at which work is returned to the team due to defects, incidents, or clarif...

Measure of team members' overall satisfaction and engagement.

Count the number of hotfixes applied by the team.

Average Time taken to resolve impediments.

Impediment Count

Number of impediments hindering team progress.

Average age of unresolved incidents or issues.

Total number of incidents or issues in the backlog.

Incident Frequency

Number of incidents reported within a defined period.

The average time elapsed between a work item achieving the team's Definition of Done and deployme...

The amount of backlog items that are 'done' based on the team's definition of done, but not yet l...

Non-Value Added Meetings

Number of meetings that do not contribute to delivering value.

Planning reliability

Comparison between planned work and actual work delivered in a sprint.

The average age of unresolved problems in the product.

The number of unresolved problems identified in the product.

Red Pipeline Recovery Time

Average time taken to restore a failed pipeline (Pipeline Red) to a healthy state.

Red Pipeline Time

Total amount of time per week for which the pipeline is in a red (unusable) state.

Ratio of work items returning to the team, in the form of defects, incidents, or clarifications.

Total time spent on redoing work due to errors or reported defects.

Security Issues Count

The count of identified vulnerabilities and threats in the product's codebase and architecture.

Security Issues Severity

Distribution of identified security issues by severity levels in the product's codebase and archi...

Degree of skill diversity and alignment of skill with workload within the team.

Measures the number of times the team violates their Service Level Agreements (SLA).

Staff Fluctuation

Measure of the rate at which team members leave or join the team.

System Test Coverage

Percentage of the system's use case scenarios covered by test cases.

System Test Defect Count

Number of defects identified during system test.

System Test Execution Rate

Percentage of planned system tests executed successfully.

Technical Debt Age

Average age of unresolved technical debt items in the team's backlog.

Technical Debt Count

Number of unresolved technical debt items in the team's backlog.

Technical Debt Ratio

The ratio of time spent on addressing technical debt versus time spent on new feature development.

Measure the number of backlog items completed in a given time period.

Time spent blocked

Total time that team members spend blocked or waiting for dependencies to be resolved.

Unit Test Coverage

Percentage of code covered by unit tests.

Unit Test Execution Rate

Percentage of unit tests that are executed within the team's development process.

Product

▼

Constraint Performance

Measure of how well the organization manages effectiveness, idle time, and overburden at the Cons...

Coordination Effort

Measurement of the time spent across teams on coordination with each other and stakeholders.

Customer Churn Rate

Percentage of customers who have stopped using the product within a given time period.

Customer Growth Rate

A metric that measures the percentage increase in the number of customers using our product over ...

Customer Retention Rate

A metric that measures the percentage of customers who continue to use our products or services o...

Customer Satisfaction Index

Assess the overall satisfaction of customers with our products or services.

Customer Support Satisfaction Rating

Satisfaction of customers with the support services provided for our product.

Delivery Cycle Time

Measures the time it takes to complete a full development cycle from first "push" to "integrated,...

Delivery Frequency

Measures how often an integrated product increment is delivered for the entire product.

Escalation Resolution Age (ERA)

Captures the duration between the product organization flagging a topic for escalation and its re...

Feature Adoption Rate

Measure how widely features are adopted by users.

Feature Usage Diversity

Measure the variety of how features are actively used by different user segments to understand th...

Feature Usage Funnel

Measure and analyze the progression of user engagement through the stages of utilizing specific f...

Feature Usage Heatmap

Visualization of user interactions with various features in a heatmap format that helps understan...

Feature Usage Rate

Measure how actively specific features within the product are utilized.

Financial Throughput

Measures the financial impact generated over time.

Amount of hotfixes applied to the product.

Measures the age of unresolved incidents in the product.

Count the total number of incidents reported for the product.

Inventory In Process

Count all backlog items that are in a "wait" state after having been worked upon.

Key Person Risk

Identification of individuals whose expertise or knowledge is critical to the success of the prod...

Key Person Risk Duration

Measures the duration, in weeks, from discovery of a key person risk until it is mitigated.

Knowledge Transfer Effectiveness

Measurement of the effectiveness of knowledge transfer within the product domain.

Percentage indicating how close the product is to its capacity limits, measuring its technical load.

Net Promoter Score

A customer loyalty metric that measures how likely customers are to recommend your product or ser...

Measures the age of unresolved problems in the product, following an ITIL model.

Measures the total number of unresolved problems in the product, following an ITIL model.

Product - Impediment Age

Average age of open impediments in the product's backlog.

Product - Impediment Backlog Size

Total number of open impediments in the product's backlog.

Product Backlog Age

Measures the age of items in the product backlog.

Product Backlog Reach

Measures long it takes until teams would run dry of work, based on the current Product Backlog.

Product Backlog Size

Total number of items in the product backlog.

Product Backlog Value

Measures the overall value of items in the Product Backlog.

Ratio of rework to new work, measuring "rework" as defects, incidents, or clarifications.

Succession Readiness

Measurement of the time and effort required to bring in a successor for critical roles.

Support Response Time

Measure the average time between receiving a support request and providing an initial response to...

System Test Coverage

Percentage of the system's use case scenarios covered by test cases, reflecting the extent to whi...

System Test Execution Rate

Percentage of planned system tests executed successfully.

Measures the overall happiness and well-being of teams within the product development process.

Percentage of time the product is up and running in a usable state.

User Error Rate

Measure how often user interactions result in an error.

User Response Time

The time it takes for the user to receive a response from the product, measuring the product's re...

Portfolio

▼

Benefit Realization Rate

Proportion of planned benefits realized across the portfolio.

Budget Adherence

Measures the percentage of the budget that is adhered to across the portfolio.

Rate at which the portfolio is spending its budget over time.

Duration that current cash reserves will last at the current burn rate.

Communication Effectiveness

Overall effectiveness of formal and informal communication

Difference between planned and actual expenses over time.

Demand Realization Capacity

Alignment between available resources and initiative demands to ensure effective resource utiliza...

Financial Throughput

Rate at which revenue is generated relative to costs incurred.

Financial Throughput Variance (FTV)

Difference between actual and planned financial throughput.

Costs that remain constant regardless of production or activity levels.

Revenue Variance

Difference between actual revenue and planned revenue over time.

Total Variable Cost (TVC)

Total costs that vary directly with the level of production or activity.

Strategy

▼

Absenteeism Rate

Percentage of workdays missed due to employee absenteeism.

Benefit Realization Rate

Proportion of planned benefits actually realized over time across the portfolio.

Budget Adherence

Measures the extent to which actual spending aligns with the budget.

Constraint Throughput

Measures throughput generated by each unit of the most constrained resources.

Customer Acquisition Cost (CAC)

Measures the cost associated with acquiring a new customer.

Diversity and Inclusion Index

Measures the diversity of the workforce and the inclusiveness of the organizational culture.

EBIT (Earnings Before Interest and Taxes)

Measures a firm's profitability from operations, excluding interest and tax expenses.

EBITDA (Earnings Before Interest, Taxes, Depreciation, and Amortization)

Measures a company's overall financial performance, focusing on earnings from core operations.

Economic Value Added (EVA)

Measures value created beyond the required return of shareholders.

Employee Engagement Score

Measures the level of employee engagement within the organization.

Employee Turnover Rate

Percentage of employees who leave the organization over a specific period.

Financial Throughput

Rate at which a company generates money through sales, minus variable costs.

Gross Profit Margin

Measures the percentage of revenue that exceeds the cost of goods sold (COGS).

Labor Productivity (Revenue per Hour Worked)

Measures revenue generated per hour of labor.

Multi-Factor Productivity (MFP) / Total Factor Productivity (TFP)

Measures output growth not explained by increases in inputs.

The amount of money remaining after all expenses, including fixed and variable costs, have been d...

Operating Expenses

Total expenses incurred in the day-to-day operations of a business.

Return on Equity (ROE)

Measures profitability relative to shareholders' equity.

Revenue per Employee

Calculates average revenue generated per employee.

Total Contribution Margin

Measures the total revenue minus total variable costs, reflecting contribution to fixed costs and...

Training and Development Investment per Employee

Amount of money invested in training and development.

Unit Labor Cost (ULC)

Labor cost required to produce one unit of output.

Value Added per Worker

Measures the net value created by each employee after accounting for input costs.

Working Capital Ratio

Measures a company's ability to cover its short-term liabilities with short-term assets.